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ACCESS TO INTERNET DATA THROUGH A TELEVISION SYSTEM 

5 CROSS REFERENCE TO RELATED APPLICATIONS 

This application claims priority of Provisional U.S. Patent Applicat.on Nos 
60/028 138, filed October 16, 1996; 60/032,571, filed December 4, 1996; 60/032 1 6. filed 
December 9 1996; 60/035,236, filed January 1, 1997; 60/035,029, filed January 8, 1997, 
60/040.763, filed March 14, 1997, the subject matter of each of these applicants is fully 

10 incorporated herein. 



BACKGROUND 

The invention relates to interactive television systems capable of two-way 
communication with networked computer systems operating as information service prov.ders, 

IS in particular Internet service providers. 

The Interne, may be viewed as a large group of networked computer systems each ol 
which has a distinct alphanumeric address. A user terminal which seek s to rece ve ata to 
one of the networked computer systems win send a command to the destred 
through the network to mat system requesting .ha, a particular se, of data be sen. o the 
20 !lnal The user terminals are connected to the network through the estab shed telephone 
Tm n the user's cot— y. An .nteme. address may be lim.ted to the ****** 
^ cular networked computer sys,.m. or may include addit.ona, informer , wh^rec „ 
Lne.workedc„mpu.er system to send a particular se. of Internet data. The addmonal 
„la.ion may include a subdirec.ory. a f„e name, or both, which instructs — ed 
,5 computer system which portion of data is desired by the re,u=s,mg terminal The system w, I 
Zaft send the requested data through the network to .he .erminal. Further exchanges of 
"or ma, no, 1 place between the ten— and the networked computer system. 

Hc-nendinc unon the desires of the terminal user. 

2 World Wide Web <WWW/u,.ern=<> is an Interne, network designed for popular 
30 use Apparatus sold under the trademark -WebTV," provided by Philips-Magnavox arrd 
Tny a „w television viewers ,o access the Wo* Wide Web through the,, ,e,ev,s,ons. 

It is therefore desirable to enhance television viewing and Internet browsmg by 
provrd g a more in.ima.e interface be,ween the vtewer's te,evis,on a*d the .nteme. access 
ppararu! so that both television viewing and Interne, browsmg may be perform** 
35 slhaneously, and preferably in.erac.ive,, such ,ha, .he Interne. da,a rcla.es to the 
television program being viewed. 



BNSOOCID <WO .. 981706441 l.> 



15 



W ° 98/17064 PCT/US97/18664 

1 SUMMARY OF THE INVENTION 

According to one embodiment of the invention, an interactive entertainment network 
system is provided which includes a number of user interface units in individual homes, each 
having a tuner, a display device and a modem or other data interface device for 

^ communicating with a data service provider. A television signal provider supplies a plurality 

of television signals to the tuner of each user interface unit, wherein at least one of the 

television signals has embedded data including a particular data address site. Information 

representing the particular data address site is displayed simultaneously with the television 

program on the display device, e.g., either as a graphical icon or text. A data service provider 
in* 

in two-way connection with the modem of each user interface site retrieves and transmits 
data corresponding to a data address site requested by an individual user interface unit for 
display on the display device of that user. 

According to another embodiment of the invention, a display controller for coupling to 
a display device and to a data retrieval terminal in two-way communication with a data 
service provider is provided. The display controller includes a tuner for receiving a 
television signal containing a television program and at least one embedded data unit 
including a data address site, means for extracting the at least one embedded data unit from 
the television signal, a memory for storing the at least one data unit, and a video display 
generator. The display controller also includes a microcontroller coupled to the tuner and the 
20 extracting means and the memory for storing the at least one data unit in the memory, 

controlling the video display generator to display the data site address on the display device 
simultaneously with the television program, selectively retrieving the data site address from 
the memory in response to a user request, controlling the data retrieval terminal to request 
data corresponding to the user selected data address site from the data service provider, and 
° controlling the video display generator to format and display the requested data received from 
the data service provider on the display device. 

According to yet another embodiment of the invention, a method is provided for 
enhancing viewing of a television program with interactive information retrieval. The 
method includes the steps of, at a television signal provider, embedding at least one data unit 
30 comprising a data site address into a television signal containing a television program. Then, 
at a user site, receiving the television signal, extracting the data unit from the television 
signal, displaying information representative of the data address site simultaneously with the 
television program on a display device, and then storing the data address site in a memory. 
Once the user selects the information representative of the data address site, a connection is 
35 established with a data service provider having access to data corresponding to the selected 
data address site, the data corresponding to the data address site is requested and transmitted 
from the data service provider to the user site. The retrieved data is then formatted and 
displayed on the display device at the user site. Preferably, several data address sites are 
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stored in the memory simultaneously and, at the user's request, displayed in a menu from 
which the user can select a particular address site. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The attached figures demonstrate alternative embodiments of a system designed in 

accordance with the present invention in which 

FIG. 1 is a block diagram schematic demonstrating a system according to one 

embodiment of the present invention; 

FIG. 2 is a display including an exemplary graphical icon identifying that a data 
address site is available with the displayed television program; 

FIG. 3 is a display of an Internet mode according to another embodiment which 
includes several data address sites; ^ 

FIG. 4 is a display of the Internet mode according to the embodiment of FIG. s 
displaying data corresponding to a selected data address site; 

FIG. 5 is a plan view of a remote controller for use with an embodiment of the 

invention; , , j* + 

FIG. 6 is a display of the Internet mode according to yet another embodiment 

displaying data corresponding to a selected data address site; 

FIG. 7 is a block diagram schematic demonstrating a system according to a further 
embodiment of the present invention; data 

FIG. 8 is a table including exemplary icons representative of vanous types of data 

addressees; and ^ ^ & ^ ^ ^ ^ 

embodiment of the present invention. 

^^Acrord^g^o^rtfefered embodiment of the invention, television programs^eUnked 
to data and/o, graphics a. Interne, sites .0 expand the on sereen informal avatlab.e to 

BleV ' S '"'illustrate a specific embedment of Ute invention, In FIG. the reference 
numeral ,t me same clients described in application Serial N o. 0S,4 W 9 5 fled on 
June 6 1995 the disclosure of which is incorporated fully heretn by reference. 

Wift reference to FIG. I, a source of , Revision signals .0 such as a — 
„ ^ i, connected to a television tuner II. The output of tuner 1 1 ts a 

rblS™2 sigr^ls, respectively. The audio stgna, ,s coupled by a sound 
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amplifier (SOUND AMP) 15 to a loudspeaker 16. The video signal is coupled by a video 
amplifier not shown to one input of a switch 18. Sound detector 14 and picture detector 
1 3 are connected to the audio and video inputs, respectively, of a video cassette recorder 
(VCR) 17. (Alternatively, television signal source 10 could be directly connected to the 
RF input of VCR 17, if its internal tuner and demodulating circuitry is to be utilized.) The 
output of VCR 17 is connected to the other input of switch 18. The output of switch 18 is 
connected to one input of a conventional picture-in-picture (PIP) integrated circuit chip 19. 
The output of PIP chip 19 is connected to the video input of a television receiver or 
monitor (TV) 20 having a screen (not shown). 

Internet data, including Internet site addresses, is stored in Internet data memory 36. 
Internet data memory 36 is connected to a microprocessor 24 that is programmed to 
control the operation of the described equipment (Internet data memory 36 could be part 
of the RAM of microprocessor 24). An operating program for microprocessor 24 is 
stored in a read only memory (ROM) 26. A viewer input device 28, preferably in the 
form of a remote IR controller, is coupled to microprocessor 24 to provide commands 
from the viewer. A video processor 30 is coupled to microprocessor 24. When the viewer 
wishes to see Internet site addresses, microprocessor 24 recalls a portion of the Internet 
data from memory 36 and couples it to video processor 30, where the Internet site 
addresses are formatted for display. Preferably, the information stored in video processor 
30 is a bit map of what is displayed on the screen of television receiver 20. Video 
processor 30 is connected to the other input of PIP chip 19. Preferably, viewer input 
device 28 controls microprocessor 24 by cursor movement on the screen of television 
receiver 20. To this end, microprocessor 24 and video processor 30 are coupled to a 
cursor position register 32. (Alternatively, the viewer can select items of information 
displayed on the screen by keying into viewer input device 28 code numbers assigned to 
these items.) Microprocessor 24 is also coupled to tuner 1 1 for channel change, to VCR 
17 for play/record selection and start/stop, to switch 18 for selection of one of its inputs, 
and to PIP chip 19 for selection of the mode of PIP operation. 

According to one embodiment, an Internet service provider (ISP) 33 is connected to 
30 microprocessor 24 by a transmission link 34 such as a telephone network or a television 
cable. An interface device such as a telephone or cable modem 38, or digital interface 
device (not shown) for a fiber optic connection, couples transmission link 34 to 
microprocessor 24 if necessary. ISP 33 is connected to an Internet backbone in well known 
fashion to access data at any site on the World Wide Web, or preferably the Internet 
35 generally. 

To enable a television viewer to access data about a television program that the viewer 
is watching, Internet data is embedded in the vertical blanking interval (VBI) of the television 
signal carrying the program. According to one embodiment, the Internet data includes the 
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names and Internet addresses of a plurality of Internet sites. When the television signal 
carrying the program being watched is captured by tuner 11 , the Internet data embedded ,n us 
VBI is stripped out bv a VBI decoder 35 coupled to microprocessor 24. Microprocessor .4 
then stores the data in Internet data memory 36. The memory addresses of the Internet names 
5 are linked to the Internet addresses in memory 36. 

As shown in FIG. 2, a graphical icon 95 appears on the screen of telev.sion 20 when 
the television program is displayed full screen, i.e., in a television mode, to inform the viewer 
that Internet data accompanies the television signal and is stored in memory 36. con 95 can ^ 
appear for a limited time period after the television program is first displayed or for the ent.re 
. 0 time period of the program. If the viewer wishes to access an Internet site in connecUon w,th 
the television program, the viewer presses mode button 56 on a remote contro ler 50, shown 
in FIG 5 which introduces an Internet mode of operation described below. M.croprocessor 
24 is programmed to carry out this operation. By repeatedly pressing mode button 56, the 
viewer can toggle back and forth between the television mode and the Internet mode 
1 5 In one embodiment, the Internet site information is placed in a picture-m-p.cture 

("PIP") window on the television screen such that the Internet site information may be 
ie wed simultaneously with the television program. Conversely the television signal may be 
olaced in a PIP window on the television screen as shown ,n FIGS. 3 and 4. In this 

bodirnent, the Internet site information occup.es the majority of the television screen and 
20 I television program is displayed in a PIP window. In this manner, the — 

signal may be viewed simultaneously with the Internet informal, and thus supplement the 
information provided to the viewer. A nthl > 

As shown in FIO. 3, the video portion of the television program las. vtewed m .he 
television mode is displayed in area 42 and the audio portion is reproduced by the speaker 
^5 stem of me .elevision se, As an option, a textual description of .he program » d.splayed m 
I Z 44 and ir.fonna.ion abou. me .elevision program, i.e., program n« nam 
andlnnel number are displayed in a barker 49 underneath areas 42 and 44. A messa^ s 
Isplayed a, .he top of an area 46 «o promp. .he v.ewer ,o selec, from a number tf*™. 
sue names dispiayed in area 46 by moving a cursor 48 w,.h arrow keys 58 and 60 <** 
30 FIG. 5). For example, .he Irneme. si.e names may he related ,che P-«™ ^ 
'MARRIED WITH CHILDREN' TRIVIA"), me particular broadcas er (2. TONIGHT ON 
FOX (SCHEDULE)"), general services offered by the sys.em prov.de, < X SPORTS ,4. 
SHOPPING") or directed .o the particular user's Interne, account ( 5. E-MAIL ) 

Ato - interne. si,e name is seleced, ,he viewer presses INFO burton 54 on . 
ii *1 As a result .he Interne, si.e address to which the selected ln.eme, stte name ,s 
33 ^^^Jl«»»<*»>^»'«*« .hroughthcelep^eor 
a* i rface ,o ISP 33. Once .he microprocessor 24 has been directed to tnmate » 
acquis!, i. will insuuc, .he modem 25 ,o connec, to an ln.eme. sewtce provtder (ISP). 

-5- • 
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After establishing a connection to the ISP, the microprocessor 24 initiates a data request ft 
the Internet site address which was received along with the graphical icon transmitted in the 
data unit. The microprocessor 24 thereafter receives the requested Internet data, and stores it 
in RAM. The requested Internet data may include graphics, text, or a combination of both. 
After receiving the Internet data, the microprocessor may or may not terminate the modem 
connection to the ISP, depending upon the design of the embodiment, or the configuration 
options set by the viewer. (If desired, this ftmction of microprocessor 24 could be carried out 
by commercial equipment sold under the trademark "WebTV," provided by 
Philips/Magnavox and Sony.) 

The information at the addressed Internet site is downloaded from ISP 33 over 
transmission link 34 to microprocessor 24 and then displayed on the screen simultaneously 
with the television program to which the information relates, as illustrated in FIG. 4, after 
being composed by video processor 30. As illustrated in FIG. 4, the name of the Internet site 
can be displayed above the text of the information from the Internet site. If the television 
program is a television series such as "Married With Children," the displayed information 
could be an Internet "page" trivia about the show (FIG. 4), merchandising and home 
shopping information, or a link to a fan e-mail site. The viewer then navigates about the 
Internet site in the manner dictated by the viewer's software to find the desired information. 

Only an initial portion of the Internet data is displayed, as the amount of Internet data 
received will likely exceed the amount conveniently displayable at one time. The viewer 
may "scroll" through the remainder of the Internet data or "page," at his or her discretion, in 
one embodiment by utilizing arrow keys on a remote control. The user interface of the page 
viewing may be accomplished in a conventional manner, e.g., in the manner of a typical PC- 
based web browser, or the user interface associated with WebTV, provided by Philips- 
25 Magnavox, or Sony. 

If desired, the display of FIG. 3 could be eliminated. In other words, only one Internet 
site address would be embedded in the VBI of the television signal and the viewer would not 
make an Internet site selection. In this case, inclusion of the Internet site name is optional, 
because the viewer does not have a choice of Internet sites. When the viewer wishes to 
access Internet information about a program marked with an icon, the viewer presses button 
56, the VBI Internet site address is sent through the telephone or cable interface to ISP 33, 
and the display of FIG. 4 appears directly on the screen with the VBI Internet site name. 
Preferably, the television program is displayed full screen until the data retrieved from the 
ISP 33 is available for display, i.e., after establishing a connection with the ISP 33, requesting 
35 the data, etc. Preferably, the graphical icon 95 ceases to be displayed once the viewer selects 
the Internet data. 

In a typical Internet "web page," there are "links" to other Internet addresses, which 
provide alternative or complementary data to that found in the originally displayed web page. 
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I ln a preferred embodiment of the invention, a user may select one of these links with a 

remote control, utilizing arrow keys 58, and/or on-screen cursor 48. For example, in FIG. 4. 
the answer to the trivia question is contained in a linked web page the viewer can select to 
confirm his or her response. These links are commonly referred to as "hypertext" links. If a 

5 link is selected, the microprocessor transmits the desired address to the ISP, and thereafter 
receives and displays the newly-received Internet data in the manner described above. Thus, 
if it is desirable to allow the viewer to link to additional Internet site addresses, the 
microprocessor should maintain the modem connection to the ISP 33 until directed by the , 
user to terminate the connection. In this manner, the repeated request and receipt of 

10 successive pages will not necessitate delays associated with initiating a connecuon to the ISP 

33 

In order to accommodate the simultaneous viewing of both the Internet site Internet 
information and the television signal, particularized display formats may be used. In a 
further embodiment, the information for the Internet site is formatted to fit around the PIP 

1 5 window in which the television program is displayed, as shown in FIG. 6. Typical Internet 
data received over the World Wide Web is transmitted in Hypertext Markup Language 
("HTML") A typical HTML file includes text, graphics, and instructions for formattmg the 
text and graphics on a screen, along with other embedded commands. A computer or other 
terminal displaying an HTML file will format the file for display on the screen, based m part 

20 upon the embedded instructions for formatting the text and graphics, and based in part upon 
the requirements for aesthetic and efficient display of the information on the particular 

viewing device. . 

When displaying two video signals simultaneously using the PIP format, typically one 

video signal occupies the majority of the viewing screen, while the second video signal is 

25 displayed in or near to one corner of the television screen and typically occupies one quarter 

of the screen or less. With this type of display format, the second video signal obscures a not 

insubstantial portion of the first video signal. This can result in an inefficient and undesirable 

display of information to the viewer when PIP is used in connection with the present 

30 - mVCnt Hence one aspect of the present invention includes a microprocessor adapted to format 
the HTML file received over the Internet in such a manner as to accommodate the television 
program signal in one portion of the television screen. In this manner, the tele vision program 
signal may be viewed simultaneously with the Internet HTML information, without 
obscuring any of the Internet HTML information by the television program signal. For 

35 example, if it is desired to place the television program signal in a PIP window m the top 
right hand corner of the television screen, the HTML file should be reformatted by the 
WebTV terminal (or other Internet display device associated with the system) to disp ay 
information only in the remainder of the screen, such that it will not be obscured by the 
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overlaid television program signal. In this instance, the HTML file would be reformatted into 
the U L" shaped display 69 of FIG. 6, so that the right hand corner of the Internet video signal 
contains no information to be obscured by the television program signal. 

It should be noted that the user interface of this embodiment is designed so the 
television remote controller 50 can also be used to navigate the website, in addition to 
operating the television and guide functions. 

According to another embodiment of the invention, shown in FIG. 7, a conventional 
television 70 is provided with a Vertical Blanking Interval (VBI) decoder 72 and a separate 
Internet access type terminal 74 connected to the Internet, for example apparatus sold under 
the trademark "WebTV". A microprocessor 76 that controls the operation of the television 
70 is programmed to perform the functions described below. 

The Internet access terminal 74 includes a microprocessor 78, a Random Access 
Memory 80 (RAM), a modem 82, a user input device such as a remote control 50 or a 
keyboard 86, and a video signal generator 88. In typical operation, the microprocessor 78 of 
15 the Internet access terminal 74 will receive user input regarding particular data to be received 
over the Internet; utilizing the modem 82, the microprocessor will receive the desired data 
(typically a "web page" consisting of formatted text and/or graphic images) and output a 
video signal suitable for displaying the desired data on the screen of an attached television 
monitor. 

20 Television 70 has a tuner 89 and RAM 90 coupled to Internet access terminal 74. The 

Internet access terminal 74 sends a video signal to the television set. The microprocessor 76 
is provided with an infrared transmitter 92 to send commands to the Internet access terminal 
74. Additionally, keyboard 86 or remote controller 50 is configured to send infrared 
commands to either the Internet access terminal 74 via IR receiver 101 or to the television 70 

25 via IR receiver 93. 

The Internet access terminal 74 is coupled via a standard telephone line to ISP 33, 
which functions in the displayed embodiment as an ISP. The server is configured to send and 
receive data over the World Wide Web (WWW/Internet) to and from computer systems 
networked thereto. 

30 in a preferred embodiment of the present invention corresponding to the system shown 

in FIG. 7, data representative of on-screen graphical icon, along with an associated Internet 
site address, is transmitted as a single data unit, packet, or group of packets in the VBI of a 
television signal. The VBI has been demonstrated over the past two decades to be a suitable 
vehicle for the transmission of digital data along with a television signal. In particular, the 

35 VBI is well-adapted for the transmission of relatively small packets of data. The graphical 
icon 95 is displayed on-screen with the associated television signal as described above in 
reference to FIG.2. 

A television signal incorporating the above mentioned data unit is sent by a television 
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I stalion 96. and is carried by a cable provider. In alternative embodiments, the television 

signal may be sent by conventional broadcast, or by satellite. When the television signal is 
carried by cable, the user's home is typically equipped with a cable decoder 98. which 
extracts the tuned video signal, which is the television signal combined with the data unit in 

5 the VBI The cable decoder 98 is capable of being controlled by the microprocessor by 

infrared transmitter (not shown in the drawings). The video signal is thereafter delivered to a 
VCR 100, which also is capable of being controlled by the microprocessor by infrared 
transmitter (not shown in the drawings). Both the video signal and the data in the VBI of the 
video signal are delivered to the television 70. VBI decoder 72 for separating the data in the 

1 0 VBI from the video signal, and for delivering that data to the microprocessor. 

Data units may be transmitted in the VBI of all channels serving a particular broadcast 
region or they may be included by program creators (producers, advertisers, etc) in the VBI 
of the videotape provided to a broadcaster. In this manner, when the program is replayed lor 
broadcast by a broadcaster, the data unit containing the Internet site address and other 

1 5 information is present in the broadcast and may be received by any apparatus viewing the 

program. . 

The information at the Internet site corresponding to the transmitted Internet site 

address is preferably related to the content of the program currently being telecast in the 
television signal, which contains the data unit transmitted in the VBI. Preferably, a 
20 descriptive title for the Internet site address that will enable the viewer to distinguish the 
Internet site from other Internet sites is also included in the data unit. When the data unit 
transmitted in the VBI is received at a television receiver with the program, it is stored in a_ 
temporary buffer portion 102 of the RAM 90. Preferably, the storage capacity of the 
temporary buffer is one data unit, so that each new data unit overwrites and replaces the 
25 previously received data unit. Alternatively, each successively received data unit is placed 
on the top of a stack in RAM, so that previously received data units will still be accessible to 
the microprocessor if desired by the viewer. 

The extracted data includes data representative of an on-screen graphical icon and an 
Internet site address, as referred to above in reference to FIG. 2. The microprocessor 
30 superimposes the graphical icon 95 on a portion of the displayed video signal, thus mdicat.ng 
to the user that additional information concerning the television program is available through 
the Internet. The graphical icon will preferably be placed in an unobtrusive portion of the 
television signal, e.g. such that it is displayed on a corner of the television monitor as shown 
*n FIG ^ 

35 The viewer is thereby alerted to the presence of additional information concerning the 

displayed television program. At the viewer's initiation, the microprocessor may begin the 
process of acquiring the desired additional information over the Internet. The viewenn.tiates 
the process of data acquisition by pressing SELECT button 58 on remote controller ,0 (see 

-9- 



BNSDOCID <WO 9S17064A1 ! > 



WO 98/17064 



PCT7US97/18664 



FIG. 5) or other viewer input device. Alternatively, the viewer initiates the process by 
pointing a cursor 108, with a mouse or other pointing device (not shown), to the location of 
the on-screen icon 95, as shown on the exemplary full screen display of FIG. 2. 
Alternatively, the viewer may direct the microprocessor to store the Internet site address and 
descriptive title in the manner referred to above for later use responsive to an on-screen 
selection process. 

The graphical icon 95 is overlaid on the screen as soon as it is received and is thus 
displayed simultaneously with the program. If the viewer wishes to receive more information 
about the displayed program, e.g., more details about a commercial, additional details 
concerning a news story, or statistics about a sporting event, the viewer presses a STORE 
button 55 on remote controller 50 (see FIG. 5) to transfer the Internet site address and the 
corresponding descriptive title, e.g., "Today's NFL Game Scores" to a directory portion of 
the RAM and to extinguish the icon on the screen. Any number of Internet site addresses can 
be stored in the directory in this manner as the television viewing session progresses. 

Alternatively, the viewer may press a button 54 on the remote control, designated by 
"INFO" or some other informative designation, to access a menu of options. One option is 
to store the Internet site address and associated descriptive title. Another option may be to 
immediately access the Internet and obtain the additional information. Other options 
consistent with the disclosure of the present invention may be present on the menu presented 
to the viewer. 

According to yet another embodiment corresponding to the system shown in FIG. 7, 
the directory is managed as a web browser bookmark memory. The website addresses and 
titles are stored in the directory until they are deleted or replaced by new addresses and titles 
on a first-in-first-out basis when the directory is full. Alternatively, the newly received 
website addresses replace old addresses and titles on a next-in, least-used basis, i.e., when a 
new website address and title is received, it is stored in memory in place of either the most 
infrequently accessed website address/title in the bookmark memory, or in place of the least- 
recently accessed website address/title. Preferably, the microprocessor is programmed to 
permit the individual user to select which mode of memory management to utilize. 

When the viewer wishes to establish a connection to the Internet site of one of the 
stored addresses, the viewer presses a MENU button 57 to display the Internet site titles, and 
optionally the corresponding Internet site addresses, stored in the directory. The viewer 
selects the desired title with on screen cursor 108 and then presses a SELECT button 58. As 
a result, the microprocessor transfers the corresponding Internet site address to the Internet 
access terminal 74, the Internet site is connected to the Internet access terminal 74 and 
information from the Internet site is displayed on the screen instead of the television program. 

In yet another embodiment corresponding to the system shown in FIG. 7, the present 
invention is incorporated into a cable decoder 98. In a standard cable decoder, there are 
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present a m.croprocessor 1 1 8, an on-screen display facility 1 20, a VBI decoder 1 22 (in 
addressable decoders), and a tuner 124. Thus, the present invention may be implemented 1 ,n a 
cable decoder environment with the addition of a modem 126 for data connect.on to an ISP. 
and sufficient RAM for the receipt and display of the Internet "web page." As bid.iect.ond 
ransmis,on by cable becomes available, the telephone modem 126 can be elim.nated and the 
ZZs^ in conjunction with suitable hardware, can be used to connect the user termmal 

to the Internet or other data provider. 

[„ a further embodiment, rather than receiving the desired additional informatton over 
,he Interne,, a dedicated computer system 128 could be utilized. In a system of ,h,s nature. 

edicated system would serve as a clearinghouse o, dedicated database for the storag of 
the related information. When a broadcaster desired ,0 provide additional mformattc m .. 
mn fers the additional information and a unique identify^ code to the «>-~ 
utilizing conventional techniques. Additionally, the information may be transmuted to the 
2ed database „„ a television or cable signal. Ftnally. the additional mformatton may 
be supplied to the user in the form of a CD-ROM or other large scale portable memory 
d vice Thereafter, when a user desired additional informatton, the m.croprocessor would 
ntaa e a connection to the dedicated system to receive and display the addtnona hnfomtatton 

«er desenbed above. Such a dedicated system could be 
so tha, some information could be supplied to the user b, Interne, *'r£ZZ* 
could be supplied by the dedicated system. The dedtcated system could be the use. own 
personal computer system so that the data site addresses reeved over the VBI c«espond 
data previous!, stored, ■* one of the above-described methA ,n the user s personal , 
rnmnuter e c in a CD-ROM or transferred by modem. 

1 a oto embodiment of the present tnvention, Interne, data a, an Internet ^ may 
also be linked to particular television programs to expand the informatton avatlable to an 
Zl Wser Specially, Interne, ,ex, or graphics a, an Internet site is marked w h an 
„ or designated as hypertex, ,0 represent tha, a rela,ed .elevision program ,s scne uled for 

. f « «*« c„ u ,d b e used „ **** ^ 

programs and programs to be telecast in the nature. The .com ; are« a * 

internet site representing channel, day, time, and length (,.e„ CDTL) or the relaieote 

llTZ* of the invention is parttcularly conven.en, for a .elevision af.conado 
"Z::Z ~ Guide* articles on l,ne to die, on hypertext in the article to set 

I a program *- viewing or recording. !f the mterne, user wishes to -« 

up a television p b ^ m mQ chck t0 watch 

record a telev.s.on program the user chek .0* ^ ^ ^ ^ 

and two clicks to record, and the CDTL data is transmme 

W.hTV terminal at the user's location. The WebTV terminal couples the CDTL data to 
Xce- .f the CDTL data .dentif.es a currently telecast program, the m.croprocessor 
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operates the television receiver or the VCR, depending upon whether one click or two clicks 
were entered, and sets the appropriate tuner to the designated channel. If the CDTL data 
identifies a fiiture program, the microprocessor stores the CDTL data in the recording/play 
stack for use in recording or play at the designated time. 

The embodiment depicted in FIG. 7 is therefore capable of performing the functions 
described above in accordance with the present invention. In addition, the ISP is capable of 
providing data to be incorporated into the VBI of the transmitted television signal which 
notifies a particular user that he or she has received electronic mail. Thus, when viewing 
television, the viewer may be informed by an on-screen icon 130 that he or she has received 
electronic mail, and the viewer may thereafter direct the microprocessor to control the 
Internet access terminal 74 to obtain and display the electronic mail message or messages. 
When this function is implemented, the VBI includes an identification code or address that 
uniquely designates a particular viewer's apparatus, so that only the designated apparatus at 
the site where the electronic mail message is received actually displays the electronic mail 
icon. The electronic mail data units with identification codes are routed to the respective 
broadcast regions where the recipients are located. The data to be broadcast to a particular 
region may be provided to a network affiliate in that region to be inserted into the VBI before 
broadcast. 

The data unit transmitted to a particular user to inform him or her that he has received 
electronic mail may also include the subject or sender of the mail message. In this manner, 
the viewer may view the subject or sender of the mail message on the television screen 
without connecting to an ISP to receive the entire mail message. The viewer may therefore 
"screen" his or her E-mail, and connect only when the mail message is of interest or 
importance to him or her. Data units indicating the presence of electronic mail, or other 
uniquely addressed data units may be transmitted on all channels of a particular broadcast 
region, or may be provided on a single channel to which the tuner tunes when the television 
is not in use. When not in use, the microprocessor may therefore monitor the VBI of this 
single channel and obtain any directly addressed data units. Alternatively, an apparatus may 
be equipped with two tuners, one of which is constantly tuned to the channel containing the 
VBI data, and one of which is used to tune to television signals for display. 

As shown in FIG. 8 potential on-screen icons include an icon 132 representative of the 
availability of additional information in a video program. For example, an extended 
advertisement, or how-to show, or local information program may be available at another 
time or on another channel. By pressing an appropriate button on the remote control, the 
microprocessor may be directed to record that show. Data in the data unit representative of 
CDTL may be placed into a location in the RAM, such that the VCR is set to record the 
program at the time of its airing. In addition, a data unit may be transmitted and directed to a 
particular user's apparatus which carries a command to the microprocessor to record a 
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television prooram at a particular channel, date, time, and length. If a user is not present to 
program his or her VCR for recording, he or- she may direct that a data unit be sent to his or 
her apparatus with a command to record a particular program or programs. The command 
could be complex recording sequence configured for serially broadcast television prograrns 
such as a minisenes which airs at different times on different nights of the weeL Tbs can be 
particularly useful when a user has forgotten to program a future recording, but has ft hts or 
her home. The user may direct the transfer of such a data unit using electron, mad to an 
ISP or by telephone link to a location which will direct the actual transfer of a data untt. 
' Another potential on-screen icon is an icon representative of an Internet website 
) address .ink 1 34. As described above in detail, the user may select this icon to obtain an 
internet site address for locating and viewing additional information concerning a particular 

news show, sports event, or advertiser. 

A third potential on-screen icon is an icon representative of a VCRPlus+ bnk 136 
which may be provided, for example, in connection with an advertisement for another 
5 I program. When a user presses the appropriate keys on his or her remote control, 
tZcro'roLr stores the CDTL of that program, which is transmitted m the data un.t, 
and records or displays the program at its time of a»rmg. 

A fourth potential on-screen icon is an icon representative of a Buy Link b8 whch 
may be provided to send an order to the provider of goods or services vial the incorporated 
>0 Tdem 77, or via the WebTV terminal 74. The microprocessor will be guided by the data m 
the data unit as to the address or other location to send the viewer's order. 

As an alternative to the standard set of ,cons, which represent the type of opt, 
available to the user, the data unit may include a particular descriptive icon which w,l be 
dlXd on the scree, For example, the transmitted icon could consist of a digitized 
25 version of a manufacturer's logo. _ 

"f ,he particular embodiment is adapted for displaymg standard,^ ,co„s . « forth 
i„ FIG 8 the digrtal da* represent of the graphical rcons could be stored ,n , RAM or 
ROM a , ,he viewer's location, wiu, the da. unit including . V**> » «* - * 
„„hicalicon In this manner, the amount of data to be transmitted may be r= uced. I 
30 SJ£ ipecialized logos are desired to be used in addition to or in place of standard^ 
r i g I da. representative of these tcons ma, be sen, in bulk at a particular.,™ 
„: lllte nigh, win the tension se, is no, KUely to be used, ~« 
unit need only include a pointer ,o ,he graphical icon, rather than the full set of d, e „al 
reoresentative of the particular icon. 
35 In ye, another embodiment the presen, inve„,,o„, ,he m.croprocessor 2 

incorporattd into the television is equipped with an infrared transmttter surtab.e for 
IsTerL data ,„ a portable device ,42, as shown ,n FIG. 9. The sys,em shown ,n HO. 9 » 
similar to the system shown in FIG. I, wi,h .dentica, components havmg ,be 
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same reference numbers. The transmitter incorporated into microprocessor 24 may also be 
provided in the form of a direct wire link, radio frequency transmitter, or some other means 
for providing digital data to the portable device. The microprocessor is adapted to transmit 
the received Internet site address and/or the descriptive title thereof to the portable device for 
storage therein. The portable device must therefore be adapted to receive the transmission as 
well as to store the transmission in RAM or some other storage means. 

Once the Internet site address and/or descriptive title have been stored in the portable 
device, the user may thereafter transfer the stored Internet site address to a personal computer 
142 suitable for connection to the Internet. The portable device 140 is therefore equipped 
with a transmitting apparatus, possibly infrared, radio frequency, or direct wire link for 
sending the digital data representative of the Internet site address to the personal computer. 
Once received by the personal computer via an interface 144, the user may connect to the 
Internet and obtain the additional information over the Internet. 

The portable device may take the form of a portable computer, such as a Pilot or 
Newton, or may take the form of a portable Internet terminal, which itself is operable to 
connect to the Internet through an ISP, possibly by wireless two-way communications such 
as a cellular telephone connection. Alternatively, the portable computer could be removed 
from the system and the microprocessor 24 could be linked in direct communication with 
the user's personal computer 142, e.g., by IR emission of information and command 
20 signals to PC interface 144. 

The described embodiments of the invention are only considered to be preferred and 
illustrative of the inventive concept; the scope of the invention is not to be restricted to 
such embodiment. Various and numerous other arrangements may be devised by one 
skilled in the art without departing from the spirit and scope of this invention 

25 
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CLAIMS: 

1 An interactive entertainment network system comprising: 

a plurality of user interface units in individual homes, each user interface unit 
comprising a tuner, a modem and a display device; 

a television signal provider for supplying a plurality of television signals to the tuner 
of each user interface unit, at least one of the television signals comprising embedded data 
including a particular data address site, wherein at each user interface unit, the particular data 
address site is displayed simultaneously with the television program on the display dev.ce; 

a data service provider in two-way connection with the modem of each user interface 
site for retrieving and transmitting data corresponding to a data address site requested by an 
individual user interface unit for display on the display device of that user. 

2. The interactive entertainment network system of claim 1, in which the data service 
provider is a networked computer system. 

3. The interactive entertainment network system of claim 2, in which the data service 
provider is an Internet service provider. 

4 A display controller for coupling to a display device and to a data retrieval terminal in 
two-way communication with a data service provider, the display controller compnsing: 

a tuner for receiving a television signal containing a television program and at least 
one embedded data unit comprising a data address site; 

means for extracting the at least one embedded data unit from the television stgnal; 

a memory for storing the at least one data unit; 

a video display generator; 

a microcontroller coupled to the tuner and the extracting means and the memory 

(a) for storing the at least one data unit in the memory, 

(b) for controlling the video display generator to display information 

) representative of the data site address on the display device simultaneously with the 

television program, 

(c) for selectively retrieving the data site address from the memory in response 
to a user request, ^ ^ ^ tQ request data correS po n ding to 

5 the user selected data address site from the data service provider, and 

(e) for controlling the video display generator to format and d.splay the 
requested data received from the data service provider on the display device. 
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5. The display controller of claim 4, in which the extracting means is a vertical blanking 
interval (VBI) decoder. 

6. The display controller of claim 4, in which the video display generator comprises a 
picture-in-picture (PIP) generator, and wherein the microcontroller controls the video display 
generator to display the television program in a PIP window simultaneously with the 
information representative of the data site address on the display device. 

7. The display controller of claim 4, in which the video display generator comprises a 
PIP generator, and wherein the microcontroller controls the video display generator to 
display the television program in a PIP window simultaneously with the requested data on the 
display devices. 

8. The display controller of claim 7, in which the video display generator further 
comprises means for formatting the requested data for display around the PIP window on the 
display device whereby none of the requested data is obscured by the PIP window. 



9. The display controller of claim 4, in which the video display generator comprises a 
graphics generator which generates a graphical icon representative of the data site address for 

20 display on the display device. 

10. The display controller of claim 4, in which the video display generator comprises a 
character generator which generates text representative of the data site address for display on 
the display device. 

25 

1 1 . The display controller of claim 4, in which the video display generator comprises a 
character generator which generates text representative of the data corresponding to the data 
site address for display on the display device. 

- 50 12. The display controller of claim 4, in which the microcontroller comprises means for 
switching between a television mode in which the television program is displayed without 
information representative of data site address and an information mode in which the 
television program and information representative of the data site address are displayed 
simultaneously. 



13. The display controller of claim 4, in which the display controller is incorporated into a 
cable box. 
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I 14. The display controller of claim 4 9 in which the display controller is incorporated into a 

video cassette recorder (VCR). 

15. A method for enhancing viewing of a television program with interactive information 

5 retrieval comprising the steps of: 

at a television signal provider, 

(a) embedding at least one data unit comprising a data site address into a television 
signal containing a television program; 
at a user site, 
10 (b) receiving the television signal; 

(c) extracting the at least one data unit from the television signal; 

(d) displaying information representative of the data address site simultaneously with 
the television program on a display device; 

(e) storing the data address site in a memory; 

15 (0 selecting the information representative of the data address site; 

( g ) establishing a connection with a data service provider having access to data 
corresponding to the selected data address site; 

(h) requesting the data corresponding to the data address site; 

(i) transmitting the data corresponding to the data address site from the data service 
20 provider to the user site; and 

0) formatting and displaying the data corresponding to the data address site on the 

display device. 

16. The method of claim 15, in which step (E) comprises storing a plurality of data . 
25 address sites in the memory. 

17 The method of claim 16 further comprising a step after step (E) of displaying a menu 
comprising at least two of the data address sites, and wherein step (F) comprises selecting a 
particular data address site from the menu. 

30 

18 The method of claim 15, in which the television program is displayed in a PIP window 
simultaneously with the information representative of the data address site. 

19 The method of claim 1 8, in which program information relating to the television 
35 program is displayed simultaneously with the television program and the information 

representative of the data site address. 
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20. The method of claim 1 5, in which the data corresponding to the data address site is 
data available through the Internet. 

21. The method of claim 1 5, in which the data corresponding to the data address site is 
purchasing information. 

22. The method of claim 15, in which the data corresponding to the data address site 
comprises commands for controlling recording of a television program. 

23. The method of claim 15, in which the information representative of the data address 
site is a textual description of the data corresponding to the data address site. 

24. The method of claim 1 5, in which the information representative of the data address 
site is a graphical icon. 

25. The method of claim 24, in which the graphical icon is a symbol identifying the data 
corresponding to the data address site as an Internet ciata page. 

26. The method of claim 24, in which the graphical icon is a symbol identifying the data 
20 corresponding to the data address site as purchasing information. 

27. The method of claim 24, in which the graphical icon is a symbol identifying the data 
corresponding to the data address site as VCR programming information. 

25 
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1 interactive entertainment network system comprising: 

' a television signal provtder for supplying a plurality of television signals at least one of 
the television signals comprising a television program and embedded data mcludmg a 
5 particular data address site including data related to the television program; 

a data service provider for retrieving and transmitting data corresponding to data 

^^"iTura^of user interface units in individual homes, each user interface unit 
l0 C ° mPriSing a tuner for receiving the at least one television stgnal from the television s.gnal 

means for extracting the data address site from the television signal, 
a memory foT storing the data address site, 

a modem in two-way communication with the data service provider, 
1 5 a display screen for displaying the television program, 

a user input for receiving a user selection, and 

a microcontroller coupled to the memory and the modem and comprising 

means for generating an identifier representative of the data address sUe 
and superimposing the identifier over the television program on the display 
20 device, 

means for retrieving the data address site from the memory m response 

to a user selection, and 

means for controlling the modem to retrieve data corresponding to the 
data address site from the data service provider in response to the user 
25 selection and configuring said data for display. 

2 . The interactive entertainment network system of claim 1. in which the data service 
provider is a networked computer system. 
30 3 . The interactive entertainment network system of claim 2, in which the date service 
provider is an Internet service provider. 

4 The interactive entertainment network system of claim 1 , in which the identifier is a 
textual description of the data corresponding to the data address site. 

35 5. The interactive entertainment network system of claim 1, in which the identifier is a 
graphical icon. 
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6. The interactive entertainment network system of claim 1 , in which the microcontroller 
displays the identifier substantially immediately after receiving the data address site. 

7. A display controller for coupling to a display device and to a data retrieval terminal in 
two-way communication with a data service provider, the display controller comprising: 

a tuner for receiving a television signal containing a television program and at least one 
embedded data unit comprising a data address site including data related to the television 
program; 

means for extracting the at least one embedded data unit from the television signal; 
a memory for storing the at least one data unit; 
a video display generator; 

a microcontroller coupled to the tuner and the extracting means and the memory 

(a) for storing the at least one data unit in the memory, 

(b) for controlling the video display generator to display information 
representative of the data site address on the display device simultaneously with the television 
program, 

(c) for selectively retrieving the data site address from the memory in response 
to a user request, 

(d) for controlling the data retrieval terminal to request data corresponding to 
the user selected data address site from the data service provider, and 

(e) for controlling the video display generator to format and display the 
requested data received from the data service provider on the display device. 

8. The display controller of claim 7, in which the extracting means is a vertical blanking 
interval (VBI) decoder. 

9. The display controller of claim 7, in which the video display generator comprises a 
picturc-in-picture (PIP) generator, and wherein the microcontroller controls the video display 
generator to display the television program in a PIP window simultaneously with the 
information representative of the data site address on the display device. 

1 0. The display controller of claim 7, in which the video display generator comprises a PIP 
generator, and wherein the microcontroller controls the video display generator to display the 
television program in a PIP window simultaneously with the requested data on the display 
devices. 
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1 1 The display controller of claim 10, in which the video display generator further 
comprises means for formatting the request data for display around the PIP window on the 
display device whereby none of the requested data is obscured by the PIP window. 

12 The display controller of claim 7. in which the video display generator comprises a 
graphics generator which generates a B raphical icon representative of the data site address for 
display on the display device. 

1 3 The display controller of claim 7, in which the video display generator comprises a 
character generator which generates text representative of the data site address for display on 
the display device. 



14 The display controller of claim 7, in which the video display generator comprises a 
character generator which generates text representative of the data correspond^ to the data 

15 s i ie address for display on the display device. 

15 The display controller of claim 7, in which the microcontroller comprises means for 
switching between a television mode in which the television pro B ram is displayed without 
information representative of data site address and an information mode in which the television 

20 program and information representative of the data site address are displayed sunultaneously . 

1 6 . The display controller of claim 7, in which the display controller is incorporated into a 
cable box. 

25 - 17. The display controller of claim 7, in which the display controller is incorporated into a 
video cassette recorder (VCR). 

18. The display controller of claim 7, in which the microcontroller displays the identifier 
substantially immediately after receiving the data address site. 

30 
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19. A method for enhancing viewing of a television program with interactive information 
retrieval comprising the steps of: 

at a television signal provider, 

(a) embedding at least one data unit comprising a data address site into a television 
signal containing a television program, wherein the data address site includes data related to 
the television program; 

at a user site, 

(b) receiving the television signal; 

(c) extracting the at least one data unit from the Television signal; 

(d) displaying information representative of the data address site simultaneously with 
the television program on a display device; 

(e) storing the data address site in a memory; 

(f) selecting the information representative of the data address site; 

(g) establishing a connection with a data service provider having access to data 
corresponding to the selected data address site; , 

(h) requesting the data corresponding to the data address site; 

(i) transmitting the data corresponding to the data address site from the data service 
provider to the user site; and 

G) formatting and displaying the data corresponding to the data address site on the 
display device. 

20. The method of claim 19, in which step (c) comprises storing a plurality of data address 
sites in the memory. 

2 1 . The method of claim 20 further comprising a step after step (e) of displaying a menu 
comprising at least two of the data address sites, and wherein step (f) comprises selecting a 
particular data address site from the menu, 

22. The method of claim 19, in which step (d) is performed substantially immediately after 
step (c). 

23. The method of claim 19, in which the television program is displayed in a PIP window 
simultaneously with the information representative of the data address site. 

24. The method of claim 23, in which program information relating to the television 
program is displayed simultaneously with the television program and the information 
representative of the data site address. 
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25. The method of claim 19, in which the data corresponding to the data address site is 
data available through the Internet. 

26. The method of claim 1 9, in which the data corresponding to the data address site is 
purchasing information. 

27 The method of claim 19. in which the data corresponding to the data address site 
comprises commands for controlling recording of a television program. 

28 The method of claim 1 9, in which the information representative of the data address site 
is B textual description of the data corresponding to the data address site. 

29. The method of claim 19, in which the information representative of the data address site 
is a graphical icon. 

30. The method of claim 29. in which the graphical icon is a symbol identifying the data 
corresponding to the data address site as an Internet data page. 

31. The method of claim 29. in which the graphical icon is a symbol identifying the data 
20 corresponding to the data address site as purchasing information. 

32. The method of claim 29, in which the graphical icon is a symbol identifying the data 
corresponding to the iota address site as VCR programming information. 
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